NIH  Program  Evaluation  Report 

An  Analysis  of  Research 
Publications  Supported  by  NiH 
19701976 

NIH  and  NICHD 


December  1980 


’  ™  f  '  ''M:' 


*i!^. 


■Jit 


{ 


T 


iV  if 


iwa”! 

"fH:.-  ■■ 

I  •  i.ii-i- 

S.'V'  -Ll.JjEX 


.'V 


mr .  _ 


P  7;  5'  '^ 

'  '''*" 

^ . :  .  • 


i!»j  -.'  -:':r 


JaEj-'t!"  ■ . 


•^i-' 


I  ' 


X.' 

-/-"'•rih 


V*  ;; 


•Jr- 


«- 


i 


,;i:7 


i-.:.  '■  ^  % 


■,,w. 


•)  .  V  /,  Vi 


’  ,  ,.fi,  "  Li^V!  -..vy 


'.  :»■<*;;, i&.: 


NIH  PROGRAM  EVALUATION  REPORT 


Analysis  of  Research  Publications 
Supported  by 

NIH  and  NICHD 


Francis  Narin,  Ph.D. 
President 

Computer  Horizons  Inc. 
Cherry  Hill,  N.J . 


Helen  Hofer  Gee,  Ph.D. 

Chief,  Program  Evaluation  Branch 
Office  of  Program  Planning  and  Evaluation 
National  Institutes  of  Health 


Principal  Contributing  Staff: 


Computer  Horizons  Inc.: 
Paul  McAllister,  Ph.D. 
Frank  Manion 


NIH: 

Patricia  McKinley 
Mary  Slagle 


.  •  m  i  ’• 

'■  ' ,  /  /■ 


■'•  r  •  ^'Ir 


■'W” 


A'' 


■,.'•■• 


'•^,'  .^■' 


'i  # . 


i»!  ’  r*  ■  *;(-' 


V) 


-’J 


I  ,  ■  ,  <•:- 

■  ..'1  ■!  !  I  ‘ 

.:’  . ’*•:  -I 


'■  f  ■  ■;>  -aV  .;  l 

ii  ,  nOv,’^  -,4^^  • 

'f>v^  , '  f  < 


Wr 


■'liJi 

'<  ■  l>vl"  ..;•  ■ 


.,:mi 

‘f •-  ;*  ■»  -f waS , 


t.... 


v.iv 


■i*u>Tiiwin 


Table  of  Contents 


Page 

Introduction  .  1 

BID  Publication  Data  Set 

Journal  Selection .  2 

Representativeness  of  BID  Journal  Set .  2 

Data  Capture .  3 

Citation  Frequency  .  3 

Subject  and  Level  Classification  .  4 

NICHD  and  NIH  Publication  Trends .  5 

NICHD  Publication  Activity  Graphs .  9 

Citation  Performance  .  12 

BID  Interdependency . 15 

Highly  Cited  Papers . 18 

Publication  Profile . 25 

Crosscutting  Research . 29 


Tables  and  Figures 

Page 

Figure  1  Funding  for  the  BIDs .  6 

Figure  2  Acknowledgements  of  Research  Support  Appearing 

in  275  Scientific  Journals .  7 

Figure  3  NICHD  Supported  Papers  in  Biomedical  Journals 

by  Research  Level  .  8 

Figure  4  NICHD  and  NIH:  Percent  of  all  U.S.  Papers  in 
Each  Scientific  Field  and  Subfield  Supported 
by  the  BID  and  by  NIH . 10 

Figure  5  NICHD  Index  of  Concentration  in  Scientific 

Fields  and  Subfields . 11 

Figure  6  NICHD:  Percent  of  BIDS'  Papers  in  the  Top 
Decile  of  Cited  Papers  by  Scientific  Fields 
and  Subfields . 13 

Figure  7  References  Given  by  NICHD  Supported  Papers 

Published  in  1973-1977  to  U.S.  Papers 
Published  in  1970-1976 .  16 

Figure  8  References  Given  by  NICHD  Supported  Papers 
Published  in  1970-1976  from  U.S.  Papers 
Published  in  1973-1977 .  17 

Table  1  Ten  Most  Highly  Cited  Papers  for  Subfield 

Fertility  in  1974:  Citing  Years  1973-1977 
Inclusive . 19 

Table  2  Ten  Most  Highly  Cited  Papers  for  Subfield 

Embryology  in  1974:  Citing  Years  1973-1977 
Inclusive . 21 

Table  3  NICHD  Publ ication 'Prof i le . 26 

Table  4  Crosscutting  Biomedical  Subfields:  Number 

of  Papers  >  100  Acknowledging  Support 
of  Each  BID  . 


30 


Analysis  of  Research  Publications 
Supported  by 

The  National  Institutes  of  Health 
1970  -  1976 


National  Institute  of  Child  Health  and  Human  Development 


INTRODUCTION 


This  report  presents  an  analytic  characterization  of  1970-1976  research 
publications  supported  by  the  National  Institute  of  Child  Health  and  Human 
Development.  A  parallel  report  has  been  prepared  for  each  of  the  National 
Institutes  of  Health  (except  NIA  and  NIEHS  for  which  sufficient  data  were 
not  available).  Since  1973,  CHI  Research  (the  research  group  at  Computer 
Horizons  Inc.)  has  worked  under  contract  to  NIH  (NOl-OD-2109)  on  the 
development  and  application  of  indicators  of  biomedical  research  activity. 
These  reports  are  an  outgrowth  of  this  collaborative  association. 

Although  publication  analyses  were  first  used  to  assess  scientific 
activity  at  least  50  years  ago,  it  is  only  in  the  past  decade  that  the 
availability  of  economical  large  scale  computer  capabilities  has  made  wide 
scale  application  feasible.  "Bibl iometrics,"  as  this  growing  assortment  of 
tools  of  analysis  has  come  to  be  known,  is  based  on  the  assumption  that 
quantitative  analyses  of  scientific  journal  papers,  and  of  the  citations 
later  received  by  these  papers,  can  provide  sensitive  indicators  of  activity 
and  change  in  scientific  productivity.  The  NIH  -  CHI  research  collaboration 
over  the  past  several  years,  and  related  NSF  supported  efforts,  have 
resulted  in  extensive  evidence  of  both  the  validity  of  the  assumption  and 
the  utility  of  the  tools  that  have  been  developed.  A  list  of  relevant 
reports  and  publications  will  be  found  in  Appendix  A.  See  also  NSF's 
Science  Indicators  (18).  Copies  of  reports  and  publications  on  the  NIH  work 
can  be  obtained  from  Dr.  Francis  Narin  at  CHI  or  from  Dr.  Helen  H.  Gee  at 
NIH. 


The  present  group  of  reports  is  intended  to  introduce  to  NIH  Bureaus, 
Institutes  and  Divisions  (B/I/Ds)  a  new  set  of  tools  for  program  review  and 
evaluation.  The  reports  are  based  on  the  1970-1977  papers  published  in  a 
selected  set  of  275  biomedical  journals.  In  1982,  the  reports  will  be 
updated  through  1980.  The  275  journals  contain,  overall,  about  80  percent 
of  the  NIH  supported  research  papers  published  during  this  period. 
Limitation  of  the  analysis  to  this  subset  of  journals  has  been  dictated  by 
the  necessity  of  examining  each  paper  individually  to  determine 
acknowledgement  of  source(s)  of  support.  Beginning  in  1981,  greatly 
extended  and  refined  analyses  will  be  made  possible  by  the  inclusion  of 
support  acknowledgement  information  in  the  National  Library  of  Medicine's 
MEDLINE  system.  A  detailed  guide  to  the  use  of  the  tables  and  graphs  in 
this  report  will  be  found  in  the  sections  that  follow. 


B/I/D  PUBLICATION  DATA  SET 


Journal  Selection 

The  publication  and  citation  information  contained  in  this  report  has 
been  drawn  from  an  analysis  of  some  600,000  papers  published  between  1970 
and  1977  in  264  biomedical  research  journals.  The  publications  attributed 
to  a  given  Institute  represent  the  combined  production  of  Intramural 
research  programs  and  Extramural  grant  and  contract  support  acknowledgements. 

The  objectives  that  guided  the  selection  of  264  journals  in  the  B/I/D 
Data  Set  were  to: 

•  Represent  all  biomedical  research  areas  by  their  most  influential 
(most  often  cited)  biomedical  journal  papers,  and  to 

•  Cover  as  many  of  the  papers  supported  by  NIH  as  possible. 

An  original  selection  of  250  journals  based  on  these  criteria  was 
increased  to  264  in  response  to  the  recommendations  of  B/I/D  and  DRG  Health 
Science  Administrators. 

Since  1973  when  the  journals  were  selected,  many  have  split  or 
subdivided  so  that  by  1977  there  were  275  journals  in  the  group.  If  the 
journal  supplements  are  counted  separately,  they  number  nearly  300.  (See 
Appendix  B.) 

Representativeness  of  the  B/I/D  Journal  Set 


Adequacy  of  the  coverage  of  the  275  journal  set  has  been  assessed 
principally  by  comparing  the  total  number  of  BID  supported  publications 
found  in  these  journals  with  the  numbers  reported  in  the  NIH  1973  Research 
Grants  Index  and  the  NIH  Directory  -  Bibliography  for  the  same  year.  In 
making  these  comparisons,  books,  abstracts,  and  other  inappropriate  (for 
this  purpose)  items  were  deleted  from  the  counts.  Overall,  approximately  80 
percent  of  NIH  supported  papers  appear  in  the  selected  group  of  275 
journals.  The  following  tabulation  shows  the  percent  of  the  total  number  of 
BID  papers  listed  in  the  source  documents  that  were  covered  by  the  275 
journal  set  in  1973. 

%  of  Reported  NIH  Supported  Papers  in  B/I/D  Journals 


NCI 

85% 

NEI 

76% 

NHLBI 

76% 

NIAID 

75% 

NIAMDD 

82% 

NICHD 

79% 

NIDR 

72% 

NIGMS 

82% 

NINCDS 

76% 

DRR 

76% 
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The  adequacy  of  the  journal  set  was  also  assessed  by  correlating  the 
number  of  papers  in  each  biomedical  "subfield"  in  the  B/I/D  set  with  the 
number  of  U.S.  papers  in  the  same  subfields  in  the  over  900  biomedical 
journals  in  the  Science  Citation  Index  ( SC  I ) .  Correlation  of  the  two  sets 
was  .98. 

Because  the  B/I/D  data  set  includes  some  foreign  papers  there  were  two 
subfields  (pharmacology  and  urology)  for  which  there  were  more  papers  in  the 
B/I/D  set  than  for  all  the  U.S.  in  the  SCI  set.  For  35  other  subfields  the 
number  of  papers  in  the  B/I/D  journal  set  ranged  from  60  to  90%  of  the 
number  of  all  U.S.  papers.  Three  subfields  had  no  papers  in  the  B/I/D 
journal  set  -  Addictive  Diseases,  Miscellaneous  Clinical  Medicine  and 
Microscopy.  Nine  other  subfields  for  which  the  B/I/D  counts  were  low,  in 
the  20  to  60%  range,  are  Miscellaneous  Biomedical  Research  (25.1%), 
Biomedical  Engineering  (29.4%),  Allergy  (37.6%),  Nephrology  (39.6%), 

Genetics  and  Heredity  (42.2%),  Hygiene  and  Public  Health  (46.1%),  Veterinary 
Medicine  (53%),  Fertility  (56.7%),  and  Nutrition  and  Dietetics  (57.5%). 

B/I/D  data  on  these  subfields  should  accordingly  be  interpreted  with  due 
caution.  It  should  be  noted,  however,  that  a  large  majority  of  the  papers 
that  are  not  covered  appear  in  journals  that  report  primarily  the  results  of 
clinical  observations  on  small  numbers  of  patients  rather  than  formal 
research  efforts. 

Data  Capture 


Development  of  the  B/I/D  data  set  required  that  every  paper  published 
between  1970  and  1977  in  each  of  the  275  journals  be  scanned  to  capture  BID 
support  acknowledgement  information.  (Beginning  in  January  1981,  this 
information  will  be  included  in  MEDLINE).  Up  to  three  research  support 
acknowledgements  were  tabulated  and  added  to  the  original  listings  drawn 
from  the  Science  Citation  Index  (SCI).  When  more  than  one  source  of  support 
was  acknowledged,  fractional  credits  were  assigned.  The  resulting  lists 
were  then  matched  to  SCI  Corporate  Tapes  to  obtain  author  institutional 
affiliations.  Up  to  three  author  institutional  affiliations  were  added  to 
the  data  set.  Finally,  the  entire  data  base  was  matched  to  MEDLINE.  This 
match  provides  titles  of  papers,  the  names  of  all  authors  (only  the  first 
author  is  captured  by  SCI),  and  MeSH  headings.  The  MEDLINE  version  of  the 
data  set  does  not  include  a  few  of  the  original  journals,  primarily 
chemistry  journals,  not  covered  by  MEDLINE. 

Citation  Frequency 


The  number  of  times  each  paper  in  the  data  set  was  cited  has  been  added 
to  the  data  base,  utilizing  the  SCI  citation  tapes  for  1973  to  1977.  In  the 
citation  matching,  B/I/D,  institutional  identifications,  and  MEDLINE  data 
have  been  retained  for  both  referencing  and  cited  author(s). 
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Subject  and  Level  Classification 


A  classification  system  for  the  journals  has  been  developed  in  which 
each  journal  has  been  assigned  to  one  of  48  subfields.  The  48  biomedical 
subfields  are  also  collectively  grouped  into  "clinical  medicine"  or 
"biomedical  (basic)  research."  The  journal  classification  thus  permits 
characterization  of  each  B/I/D's  research  support  activity  into  journal 
defined  traditional  disciplines  such  as  physiology,  microbiology, 
immunology,  pathology,  etc. 

Journals  have  also  been  assigned  to  a  "research  level."  The  level 
concept  assumes  the  exi stance  of  a  scale  ranging  from  clinical  observation 
(Level  1)  to  basic  biological  (Level  4)  journals.  The  level  designations 
and  prototype  journals  around  which  the  level  definition  was  developed  are 
as  follows: 


Level 

1  - 

Clinical  Investigation.  Prototype  Journal: 
Journal  of  the  American  Medical  Association 

Level 

2  - 

Clinical  Mix.  Prototype  Journal: 

New  England  Journal  of  Medicine 

Level 

3  - 

Clinical  Investigation.  Prototype  Journal: 
Journal  of  Clinical  Investigation 

Level 

4  - 

Basic  Research.  Prototype  Journal: 

Journal  of  Biological  Chemistry 

The  level  classification  permits  consideration 
additional  useful  perspective.  The  classification 
greater  detail  in  References  1  and  2.  Additional 
concept  may  be  obtained  by  reviewing  the  level  ass 
journals  in  the  BID  Data  Set  (Appendix  B). 
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NIH  AND  NICHD  PUBLICATION  TRENDS 


Figures  1-3  summarize  overall  trends  in  funding  and  publication  for  the 
NIH  B/I/Ds  for  which  adequate  data  are  available  (NCI,  NEI,  NHLBI,  NIAID, 
NIAMDD,  NICHD,  NIDR,  NIGMS,  NINCDS,  DRR). 

Figure  1  depicts  B/I/D  obligations  from  1965  through  1977,  in  1969 
dollars.  Note  that  there  was  an  overall  peak  in  funding  in  1968  -  1969, 
followed  by  a  brief  dip  and  a  subsequent  fairly  steady  rise.  Most  of  the 
increased  funding  in  the  early  1970s  was  concentrated  in  NCI  and  NHLBI, 
though  NEI  also  shows  a  steady  increase  in  real  obligations. 

Figure  2  shows  corresponding  publication  trends.  The  three  Institutes 
showing  the  largest  upward  trends  over  the  seven  year  period  1970-77,  NCI, 
NHLBI,  and  NEI  are  also  the  three  Institutes  that  had  the  largest  increases 
in  real  dollar  obligations  as  shown  in  Figure  1.  Relative  ranks  of  the 
B/I/Ds  on  these  figures  is  also  very  similar,  although  differences  in  ratios 
of  basic  to  clinical  research  supported  could  be  expected  to  reduce  the 
similarity. 

Figure  3  presents  data  specifically  for  NICHD  papers,  by  biomedical 
research  level.  Between  1970  and  1977  the  number  of  NICHD  biomedical  papers 
in  the  275  journal  set  increased  by  one  third,  from  slightly  more  than  800 
to  slightly  fewer  than  1100  papers.  The  increase  was  most  notable  in  Levels 
3  and  4,  e.g.,  in  1970,  38.2%  of  NICHD  supported  biomedical  papers  appeared 
in  Level  4  (basic  research)  journals;  in  1977,  the  percentage  had  increased 
to  46.1%.  The  number  of  Levels  1  and  2  papers  was  essentially  constant. 
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(MILLIONS  OF  OBLIGATED  1969  DOLLARS) 


FIGURE  1. — FUNDING  FOR  THE  B/I/Ds 
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NUMBER  OF  PAPERS  ACKNOWLEDGING  NIH.  SUPPORT  IN  275  BIOMEDICAL  JOURNALS 


FIGURE  2. — ACKNOWLEDGEMENTS  OF  RESEARCH  SUPPORT 
APPEARING  IN  275  SCIENTIFIC  JOURNALS 
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Supported  Papers/Year 


FIGURE  3:  NICHD  SUPPORTED  PAPERS  IN  BIOMEDICAL  JOURNALS  BY 

RESEARCH  LEVEL  (1977  data  includee  7%  estimate 
of  1977  papers  on  1978  tapes) 
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NICHD  PUBLICATION  ACTIVITY  GRAPHS 


The  graphs  in  this  section  present  a  detailed  bibl iometric  profile  of 
NICHD  supported  research  in  the  275  B/I/D  journals.  The  publication  data 
are  summarized  in  Figures  4  and  5. 

Figure  4  shows  the  percent  of  all  U.S.  papers  in  each  of  the  listed 
scientific  fields  and  subfields  in  the  journal  set  that  were  supported  by 
NICHD  and  by  NIH.  The  total  NIH  percent  is  shown  by  the  open  bar,  and  the 
NICHD  proportion  by  the  solid  bar.  In  the  subfield  of  embryology,  for 
example,  approximately  M%  of  the  papers  in  the  two  representative 
embryology  journals  are  supported  by  NIH;  16%  of  the  total  are  supported  by 
NICHD.  That  26%  of  the  embryology  papers  are  supported  by  other  B/I/Ds  is 
illustrative  of  the  broad  dependency  of  disciplines  on  NIH  B/I/Ds. 

Figure  5  shows  the  distribution  of  "Activity  Indexes"  for  NICHD.  The 
Activity  Index  is  a  ratio  determined  by  dividing  the  percent  of  an 
Institute's  papers  in  a  subfield  by  the  percent  of  all  journal  papers  in  the 
subfield  (as  the  subfields  are  defined  in  the  275  journal  set).  Thus,  the 
graph  displays  the  areas  in  which  B/I/D  activity  is  high  or  low  relative  to 
the  national  effort  in  a  field.  Note  that  the  NICHD  index  for  embryology 
journals  is  9.7  indicating  that  NICHD  supported  activity  in  this  subfield  is 
nine  times  greater  than  would  be  expected  based  on  the  relative  size  of  this 
field  among  all  the  fields  represented  by  the  275  journals.  Other  fields  in 
which  the  NICHD  activity  rate  is  notable  include  endocrinology,  fertility, 
geriatrics,  obstetrics  and  gynecology,  pediatrics,  and  anatomy  and 
morphology. 

When  activity  graphs  for  all  B/I/Ds  are  compared,  a  common  pattern  is 
apparent.  Each  Institute  supports  a  high  rate  of  activity  in  one  or  at  most 
a  few  clinical  fields  that  are  clearly  appropriate  to  its  mission,  and  also 
supports  a  high  rate  of  activity  in  a  small  number  of  relevant  basic 
biomedical  research  fields. 
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FIGURE  5  -  NICHD 

Index  o-F  Concentration  in  Scientific  Fields  &  Subfields 

(1970-1976  combined,  275  Biomedical  and  Related  Journals) 


INDEX 


%  of  Institute's  Papers  in  Field 
%  of  275  Journals'  Papers  in  Field 
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86 

PSYCHOLOGY 

1075 

Index 


0  I  2  3  t  6 


Index 


NOTE:  No  values  shown  for  Scientific  Fields  or  Subfields 

in  which  BID  supported  fewer  than  25  papers. 


CITATION  PERFORMANCE 


For  any  collection  of  papers  it  is  characteristic  that  the  distribution 
of  the  number  of  citations  received  is  extremely  skewed.  In  general, 
relatively  few  papers  in  a  field  are  very  highly  cited  and  relatively  many 
are  cited  once  or  twice  or  not  at  all.  Given  these  skewed  distributions, 
measures  of  central  tendency  are  of  limited  value  in  analysis.  One 
alternative  way  of  assessing  citation  impact  is  to  compare  the  frequency  of 
highly  cited  papers  between  groups. 

Figure  6  shows  the  percent  of  NICHD  supported  papers  that  are  in  the  top 
decile  of  cited  papers  in  each  subfield  represented  in  the  B/I/D  journal 
set.  This  statistic  has  the  advantage  that  a  top  decile  is  interpretable 
across  both  subfields  and  years  even  though  the  proportions  are  based  on 
different  numbers  of  citations  in  each  cited  year  and  in  each  subfield. 

Graphic  representations  are  limited  arbitrarily  to  subfields  in  which 
the  Institute  supported  more  than  25  papers  in  the  1970-76  period.  For 
NICHD  there  are  29  such  subfields.  In  27  of  the  29  subfields  more  than  10% 
of  the  NICHD  supported  papers  are  in  the  top  decile  of  cited  papers,  and  in 
ten  of  the  29  subfields  more  than  20%  of  the  NICHD  supported  papers  are  in 
the  top  decile.  The  column  of  T-score  values  for  citations  to  NICHD 
supported  papers  in  Table  3  shows  that,  on  the  average,  across  all 
subfields,  NICHD  papers  are  cited  with  more  than  average  frequency. 
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FIGURE  6  -  NICHD 


%  o-F  BID'S  Papers  in  the  Top  Decile  of  Cited  Papers 
by  Scientific  Fields  and  Subfields 
(1970-1976  combined,  275  Biomedical  and  Related  Journals) 


SCIENTIFIC  FIELDS 

Subfields 


CLIN  MEDICINE 

Genrl  &  Intopnal  Med 
Allergy 
Anesthesio logy 
Cnnccr 

CardlovsBOular  Syelen 
Dentistry 
Dermst  t  Venerl  Dls 
Endoorino logy 
Fsrtl I ity 
Oastroentero 1 ogy 
Berlatrtce 
Henato logy 
Immuna I ogy 
Obstetrics  A  Gynecol 
Neurol  6t  Neuroeurg 
Dphtbalmo I ogy 
Orthopsdios 
Arthritis  4  Rheumat 
Otorh  tnolaryngo Icgy 
Patho logy 
Pediatrics 
PharnacD logy 
Pharnacy 
Psychiatry 
Radiology  t  Nucl  Med 
Respiratory  Syaten 
Surgsry 
Tropical  Medicine 
Urology 
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Veterinary  Medicine 
Addictive  Diseases 
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B/I/D  INTERDEPENDENCY 


Another  perspective  on  the  bibl iometric  character  of  a  B/I/D  is  provided 
by  considering  its  referencing  and  citation  interaction  with  other  B/I/Ds. 

Figure  7  is  based  on  the  references  listed  in  NICHD  supported  papers;  it 
illustrates  the  dependence  of  NICHD  research  on  information  supported  by 
other  sources.  Only  21%  of  the  references  in  NICHD  supported  papers  are  to 
other  NICHD  supported  papers;  79%  are  to  papers  that  were  supported  by 
others.  Other  Institutes  upon  which  NICHD  authors  draw  most  often  are 
NIAMDD,  which  accounts  for  nearly  10%  of  the  references,  and  NIGMS  and  NCI, 
each  of  which  accounts  for  about  5%  of  the  references.  Altogether  only  16% 
of  the  NICHD  references  are  to  papers  supported  by  sources  outside  the 
Federal  government.  The  16%  of  references  to  papers  that  give  no  support 
acknowledgements  are  likely  to  be  to  "clinical  observation"  papers,  i.e., 
papers  based  on  the  observation  by  a  physician  in  practice  of  notatDle 
experience  with  a  small  group  of  patients.  Acknowledgements  of  support 
outside  the  Federal  government  are  often  the  major  societies  and  other 
private  biomedical  research  support  foundations,  state  and  local 
governments,  or  private  industry,  such  as  the  pharmaceutical  companies. 

Fi gure  8  presents  the  converse  of  Figure  7,  showing  the  citations 
received  by  NICHD  supported  papers,  according  to  the  referencing  source. 

Some  23%  of  the  citations  received  by  NICHD  papers  are  from  papers  supported 
by  NICHD,  while  67%  are  from  papers  with  other  sources  of  support. 

The  NIH  Institutes  that  cite  NICHD  papers  frequently,  accounting  for 
4-7%  of  NICHD  citations,  are  NIAMDD,  NCI,  and  NIGMS,  the  same  three 
Institutes  that  are  cited  frequently  by  NICHD  supported  authors.  NICHD 
receives  about  13%  of  its  citations  from  papers  that  contain  no  support 
acknowledgements  and  18%  from  authors  supported  by  other  than  Federal 
government  sources. 
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FIGURE  7 : 


REFERENCES  GIVEN  BY  NICHD 
PUBLISHED  IN  1973-1977  TO 
PUBLISHED  IN  1970-1976 


SUPPORTED  PAPERS. 
U.S.  PAPERS 


Note:  Size  of  circle 
proportional  to  # 
supported  papers  - 
one  arrow  for  each 
2%  of  references 
(Actual  %  indicated) 


COMPUTER  HORIZONS,  INC. 
16 


FIGURE  8:  CITATIONS  RECEIVED  BY  NICHD  SUPPORTED 

PAPERS  PUBLISHED  IN  1970-1976  FROM 
U.S.  PAPERS  PUBLISHED  IN  1973-1977 


Note:  Size  of  circle 
proportional  to  # 
supported  papers  - 
one  arrow  for  each 
2%  of  citations 


(Actual  %  indicated) 


COMPUTER  HORIZONS,  INC. 
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HIGHLY  CITED  PAPERS 


Tables  1  and  2  provide  samples  of  information  available  about  citations 
to  individual  papers.  Table  1  lists  the  10  most  highly  cited  papers  in  the 
clinical  subfield  with  which  the  Institute  is  most  closely  identified 
(usually  the  highest  Activity  Index).  Table  2  lists  the  10  most  highly 
cited  papers  in  the  biomedical  research  subfield  for  which  the  Activity 
Index  is  highest.  These  lists  are  drawn  from  1974  publications,  and  reflect 
all  citations  received  by  1977.  Inasmuch  as  no  Institute  has  direct 
responsibility  for  the  basic  biomedical  research  subfields,  and  an 
individual  Institute's  interests  may  focus  on  only  a  single  specialty  area 
within  one  of  these  broadly  defined  disciplines,  there  is  no  basis  on  which 
to  expect  that  any  particular  Institute  will  have  supported  a  proportion  of 
the  most  highly  cited  papers  in  a  basic  science  subfield.  For  the  clinical 
subfields,  expectations  may  be  more  specific. 

Lists  of  the  25  most  highly  cited  papers  supported  by  each  Institute  in 
its  fields  of  concentration,  and  lists  of  the  25  most  highly  cited  papers  in 
each  subfield  and  at  each  research  level,  for  each  year  1970  through  1976 
are  available  in  the  Program  Evaluation  Branch,  OD,  NIH  (496-4418). 
Information  provided  in  these  lists  includes  citation  frequency  rank,  the 
number  of  citations  received  in  each  year,  1973  through  1977,  journal 
identification,  author(s),  title,  level,  field  and  subfield  (L/F/S). 
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Rank 

1 


2 


3 


4 


TABLE  1:  10  MOST  HIGHLY  CITED  PAPERS  FOR  SUBFIELD  FERTILITY 

IN  1974:  CITING  YEARS  1973-77  INCLUSIVE:  CITED  AND 
CITING  PAPERS  FROM  275  JOURNAL  SET 


Total 

Cites 

Received 


Cites  Received 
by  Citing  Year 
77  76  75  74 


28 


22 


15 


14 


14 


7  9  8  4 


7  9  5  1 


4  2  5  4 


8  3  3  0 


5  3  5  1 


"Fertilization  of  Rat  Eggs  in  Vitro 
by  Epididymal  Spermatozoa  and  the 
Development  of  Eggs  Following..." 
by  Y.  Toyoda ;  M.  C.  Chang 
J  REPR  FERT,  Vol .  36,  Pg .  9 

Support  Sources:  NICHHD,  General 

Medical  Sciences;  Ford  Foundation 
Corp.  Address:  Worstr  Fdn ,  Shrewsbury 

"Carnitine  and  Glycerylphosphory Icholine 
in  the  Reproductive  Tract  of  the  Male 
Rat" 

by  D.  E.  Brooks;  D.  W.  Hamilton; 

A.  H.  Mallek 

J  REPR  FERT,  Vol.  36,  Pg .  141 

Support  Sources;  NICHHD,  Private 
Non-profit 

Corp.  Address;  Harvard  Med 

"Steroidogenesis  in  the  Preimplantation 
Rat  Embryo  and  its  Possible  Influence 
on  Morula-Blastocyst  ..." 

by  Z.  Dickmann;  S.  K.  Dey 
J  REPR  FERT,  Vol.  37,  Pg .  91 

Support  Source:  All  Unacknowledged/ 

Un ident i f ied 

Corp.  Address:  U  Kansas,  Comb  Med 

"Follicular  Fluid" 
by  R.  G.  Edwards 
J  REPR  FERT,  Vol.  37,  Pg.  189 
Support  Source:  All  Unacknowledged/ 
Unidentified 

Corp.  Address:  Fdn  Chi  Hos  Med 

"Changes  in  the  Concentration  of 
Unconjugated  Oestrone,  Oestradiol- 
17Alpha  and  Oestradiol-17Beta  in..." 
by  H.  A.  Robertson 
J  REPR  FERT,  Vol.  36,  Pg.  1 
Support  Source:  All  Unacknowledged/ 
Unidentified 

Corp.  Address:  Fdn  Chi  Hos  Med 
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TABLE 


1:  10  MOST  HIGHLY  CITED  PAPERS  FOR  SUBFIELD  FERTILITY 

IN  1974;  CITING  YEARS  1973-77  INCLUSIVE:  CITED  AND 
CITING  PAPERS  FROM  275  JOURNAL  SET  (Continued) 

Total  Cites  Received 

Cites  by  Citing  Year 

Rank  Received  77  76  75  74 

4  14  7430  "Steroid  Hormone  Production  by  Sheep 

Ovarian  Follicles  Cultured  in  Vitro" 
by  R.  F.  Seamark;  R.  M-  Moor; 

J.  E.  McIntosh 

J  REPR  FERT,  Vol.  41,  Pg.  143 
Support  Source:  All  Unacknowledged/ 
Unidentified 

Corp.  Address:  Fdn  Chi  Hos  Med 

7  13  3550  "A  DNA  Polymerase  Isolated  from  Bovine 

Spermatozoa " 

by  N.  B.  Hecht 

J  REPR  FERT,  Vol.  41,  Pg .  345 

Support  Source:  NICHHD 

Corp.  Address;  Tufts  U,  Medford 

7  13  3631  "Secretions  of  the  Testis  and  Epididymis 

by  B.  P.  Setchell 
J  REPR  FERT,  Vol.  37,  Pg .  165 

Support  Source  :  All  Unacknowledged/ 
Unidentified 

Corp.  Address:  Fdn  Chi  Hos  Med 

9  12  3450  "Oviducal  and  Uterine  Fluids" 

by  H.  M.  Beier 

J  REPR  FERT,  Vol.  37,  Pg .  221 

Support  Source;  All  Unacknowledged/ 
Unident if ied 

Corp.  Address;  Fdn  Chi. Hos  Med 

9  12  1461  "Distribution  of  a  Trypsin-Like 

Proteinase  in  the  Ram  Spermatozoon" 
by  C.  R.  Brown;  E.  F.  Hartree 
J  REPR  FERT,  Vol.  36,  Pg.  195 
Support  Source:  All  Unacknowledged/ 
Unidentified 

Corp.  Address:  Fdn  Chi  Hos  Med 

9  12  4242  "Nature  of  the  Pre-penetration  Contact 

Interactions  between  Hamster  Gametes 
in  Vitro" 

by  J.  F.  Hartmann;  C.  F.  Hutchinson 
J  REPR  FERT,  Vol.  36,  Pg.  49 
Support  Source:  All  Unacknowledged/ 
Unidentified 

Corp.  Address;  Unidentified 
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Rank 

9 


TABLE  1;  10  MOST  HIGHLY  CITED  PAPERS  FOR  SUBFIELD  FERTILITY 

IN  1974;  CITING  YEARS  1973-77  INCLUSIVE;  CITED  AND 
CITING  PAPERS  FROM  275  JOURNAL  SET  (Continued) 


Total 

Cites 

Received 

12 


Cites  Received 
by  Citing  Year 
77  76  75  74 

2  3  5  2 


"The  Effect  of  the  Concentration  of  Golden 
Hamster  Spermatozoa  on  the  Acrosome 
Reaction  and  Egg  Penet..." 

by  P.  Talbot;  L.  E.  Franklin; 

F.  N.  Russell 

J  REPR  FERT,  Vol .  36,  Pg .  429 

Support  Source  ;  NICHHD 
Corp.  Address:  U  Houston 
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TABLE  2:  10  MOST  HIGHLY  CITED  PAPERS  FOR  SUBFIELD  EMBRYOLOGY 

IN  1974;  CITING  YEARS  1973-77  INCLUSIVE:  CITED  AND 
CITING  PAPERS  FROM  275  JOURNAL  SET 


Total 
Cite  s 

Rank  Received 
1  37 


Cites  Received 
by  Citing  Year 
77  76  75  74 

14  16  7  0 


2  24  9771 


3  23  6782 


4  21  8  6  6  1 


"Creatine  Kinase  and  Aldolase  Isoenzyme 
Transitions  in  Cultures  of  Chick 
Skeletal  Muscle  Cells" 

by  D.  C.  Turner;  V.  Maier, 

H.  M.  Eppenberger 
DEVELOP  BIO,  Vol.  37,  Pg .  63 

Support  Sources:  Muscular  Dystrophy  Assoc. 
Corp.  Address:  Fdn  Chi  Hos  Med 

"Control  of  Corneal  Differentiation 
by  Extracellular  Materials. 

Collagen  as  a  Promoter  and 
Stabilizer. . . " 

by  S.  Meier;  E.  D.  Hay 
DEVELOP  BIO,  Vol.  38,  Pg.  249 
Support  Source:  NICHHD 
Corp.  Address:  Harvard  Med 

"Myogenic  Fusion  and  the  Duration  of 
the  Post-Mitotic  Gap  (Gl) . 

by  P.  A.  Buckley;  I.  R.  Konigsberg 
DEVELOP  BIO,  Vol.  37,  Pg.  193 
Support  Sources:  NSF,  NICHHD 
Corp.  Address:  U  Va ,  Charlottesville 

"Ecdysone  Levels  During  Metamorphosis 
of  Drosophila  Melanogaster " 


by  D.  H. 

B  o  r  s  t ;  W  .  E  . 

Bollenbacher 

J .  D  . 

0  '  Connor ;  D . 

S  .  K  i  n  g  ; 

J  .  W . 

Fristrom 

DEVELOP 

BIO,  Vol.  39, 

Pg.  308 

Support 

Sources :  NSF , 

NINCDS  , 

General  Me  ical  Sciences 
Corp.  Address:  U  Cal,  Berkeley; 
UCLA  and  other 


4  21  6780  "The  In  Vitro  Cell  Fusion  of  Embryonic 

Chick  Muscle  without  DNA  Synthesis" 
by  J.  L.  Doering;  D.  A.  Fischman 
DEVELOP  BIO,  Vol.  36,  Pg.  225 
Support  Sources:  NHLBI,  NSF, 
Unspecifieid  PHS 

Corp.  Address:  U  Chicago  -Pritz  Med 

6  19  5851  "Histones  and  Histone  Synthesis  in 

Sea  Urchin  Development" 

by  J.  V.  Ruderman;  P.  R.  Gross 
DEVELOP  BIO,  Vol.  36,  Pg.  286 
Support  Sources:  NIH,  NSF 
Corp.  Address:  MIT,  Cambridge; 

U  Rochester,  Rochester 
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TABLE  2:  iQ  MOST  HIGHLY  CITED  PAPERS  FOR  SUBFIELD  EMBRYOLOGY 

IN  1974:  CITING  YEARS  1973-77  INCLUSIVE:  CITED  AND 
CITING  PAPERS  FROM  275  JOURNAL  SET  (Continued) 


Total  Cites  Received 

Cites  by  Citing  Year 

Rank  Received  77  76  75  74 

7  16  5  4  7  0 


7  16  5  3  3  5 


7  16  6  4  ^0 


10  15  5  6  4  0 


10  15  6  4  5  0 


"An  Analysis  of  the  Partial  Metabolic 
Depression  of  Sea  Urchin  Eggs  by  Ammonia: 
The  Existence  of  In..." 

by  O.  Epel;  R.  Steinhardt, 

T.  Humphreys;  D.  Mazia 
DEVELOP  BIO,  Vol.  40,  Pg .  245 

Support  Sources:  NSF,  Private  for 
Profit 

Corp.  Address:  U  Cal,  Berkeley;  U  Cal, 
San  Diego;  U  Hawaii,  Honolulu 

"Formation  and  Structure  of  the 
Fertilization  Envelope  in  Xenopus  Laevis" 
by  R.  D.  Grey,  D.  P.  Wolf, 

J .  L .  Hedrick 

DEVELOP  BIO,  Vol.  36,  Pg.  44 
Support  Sources:  Rockefeller  Fdn , 
NICHHD;  NIH 

Corp.  Address:  U  Cal,  Davis 

"Development  of  Preimplantation  Rabbit 
Embryos  in  Vivo  and  in  Vitro.  II.  A 
Comparison  of  Qualitative  Aspects  of 
Protein  Synthesis" 

by  Jonathan  Van  Blerkon,  Cole  Manes 
DEVELOP  BIO,  Vol.  40,  Pg .  40 

Support  Sources:  NICHHD 

Corp.  Address:  U  Colo,  Boulder;  U  Colo 
Med  Ctr 

"Morphogenetic  Interactions  between 
Rotated  Skin  Cuffs  and  Underlying 
Stump  Tissues  in  Regenerating  a..." 
by  B.  M.  Carlson 
DEVELOP  BIO,  Vol.  39,  Pg .  263 

Support  Sources:  Muscular  Dystrophy 

Assoc;  State,  Local,  Reg  Govt. 

Corp.  Address:  U  Mich  Med 

"A  Developmental  Study  on  the  Capacity 
of  Rabbit  Granulosa  Cells  to  Respond 

to  Trophic  Hormones  and  ..." 

by  G.  F.  Erickson;  J.  R.  Challis, 

K.  J.  Ryan 

DEVELOP  BIO,  Vol.  40,  Pg .  208 

Support  Sources:  Rockefeller  Fdn; 

Private  non-profit 
Corp.  Address;  Harvard  Med 
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TABLE  2  :  10  MOST  HIGHLY  CITED  PAPERS  FOR  SUBFIELD  EMBRYOLOGY 

IN  1974:  CITING  YEARS  1973-77  INCLUSIVE:  CITED  AND 
CITING  PAPERS  FROM  275  JOURNAL  SET  (Continued) 


Total 

Cites 

Rank  Received 
10  15 


Cites  Received 
by  Citing  Year 
77  76  75  74 

7  4  3  1 


10  15 


5  6  3  1 


10  15 


7  3  5  0 


"Electrophysiologic  and  Morphologic 
Properties  of  Neurons  in  Dissociated 
Chick  Spinal  Cord  Cell  Cultu..." 

by  G.  D.  Fischbach;  M.  A.  Dichter 
DEVELOP  BIO,  Vol.  37,  Pg.  100 
Support  Sources:  NICHHD 
Corp.  Address:  NIH 

"Expression  of  Neuronal  Phenotypes  in 
Neuroblastoma  Cell  Hybrids" 

by  F.  A.  McMorris,  F.  H.  Ruddle 
DEVELOP  BIO,  Vol.  39,  Pg .  226 

Support  Source:  General  Medical 
Sciences 

Corp.  Address:  Yale  U,  New  Haven 

"Studi&s  on  the  Appearance  and  Nature 
of  a  Maturation-Inducing  Factor  in 
the  Cytoplasm  of  Amphibian  ..." 
by  J.  K.  Reynhout;  L.  D.  Smith 
DEVELOP  BIO,  Vol.  38,  Pg.  394 
Support  Sources:  NICHHD;  NSF 
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PUBLICATION  PROFILE 


Table  3  is  a  B/I/0  publication  profile  that  summarizes  bibliometric 
activity  for  the  Institute  for  the  period  1970-1977.  The  Table  counts  all 
papers  published  in  the  B/I/D  journal  set  in  the  years  1970  through  1976  and 
counts  citations  received  by  these  papers  from  1973  through  1977. 

The  first  page  of  the  Profile  presents  the  data  for  all  fields  combined, 
for  each  Research  Level  and  for  each  of  the  Major  Fields.  Page  2  lists  the 
individual  subfields  of  Clinical  Medicine  and  page  3  lists  the  individual 
subfields  of  Biomedical  Research.  Following  are  definitions  of  the  column 
her  dings: 

1  Number  of  Papers  -  the  fractional  number  of  papers  supported  by 
this  B/I/D  in  the  particular  Level,  Field  and  Subfield  (L/F/S). 

2  Activity  Index  -  proportion  of  the  B/I/D's  papers  in  the 
particular  L/F/S  divided  by  the  proportion  of  all  papers  in  the 
B/I/D  journal  set  in  the  particular  L/F/S. 

3  %  Internal  Effort  -  Percent  of  the  B/I/D's  papers  in  the 
particular  L/F/S. 

4  %  External  Effort  -  Percent  of  all  papers  in  the  B/I/D  journal 
set  in  the  particular  L/F/S  supported  by  this  B/I/D. 

5  Total  Cites  -  Total  citations  (from  all  journals  in  B/I/D 
journal  set  for  citing  years  1973  -  1977)  received  by  the  papers 
supported  by  this  B/I/D  in  the  particular  L/F/S.  Scaled  to  the 
average  citation  rate  for  each  L/F/S  in  1972. 

6  Cites  per  Paper  -  Total  scaled  citations  received  divided  by  the 
number  of  papers  supported. 

7  Cite  T-Score  -  This  BID'S  citations  per  paper  minus  the  average 
citations  per  paper  for  all  papers  in  the  particular  L/F/S, 
divided  by  the  standard  deviation  of  citations  per  paper  for  all 
papers  in  the  particular  L/F/S.  The  statistic  is  scaled  to  a 
mean  of  50  and  standard  deviation  of  10. 

8  %  Papers  Among  the  Top  10%  -  Percent  of  this  BID'S  papers  in  the 
particular  L/F/S  that  are  among  the  top  10%  of  the  most  highly 
cited  of  all  papers  in  the  particular  L/F/S. 

Please  note  that  although  the  publication  profile  presents  analyses  for 
any  number  of  papers,  the  data  are  likely  to  be  unstable  when  based  on 
aggregates  of  less  than  about  25.  The  skewness  of  citation  distributions 
permits  only  approximate  statements  about  confidence  limits;  however,  it  may 
be  said  that  to  achieve  a  95  percent  confidence  interval  of  ±2  citations,  a 
sample  size  of  20  is  required. 
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TABLE  3 


PAGE  1 


BID  PUBLICATION  PROFILES 

CHILD  HEALTH-HUMAN  DEVELOPMENT  -  NICHHD 
CITED  YEAR  X  1970  -  76 

BASED  ON  CITES  RECEIVED  FROM  ALL  CITING  YEARS  1973-77 
CITED  AND  CITING  ARTICLES  FROM  293  BID  JOURNAL  SET 


CITES*  %  PAPERS 


LEVEL/FIELD/SUBFIELD 

NUMBER 

PAPERS 

ACTIV 

INDEX 

y.  INT 
EFFRT 

y.  EXT 
EFFRT 

TOTAL* 

CITES 

PER 

PAPER 

CITE 

T-SCR 

AM0N(3 
TOP  10% 

FIELDS  Cl-91 

8451 . 

1.00 

100.00 

1.69 

73172. 

8.7 

52.25 

15.79 

CLINICAL-MIX  Cl 

-2D 

2249. 

0.98 

26.61 

1.65 

11200. 

5.0 

51.54 

14.83 

CLIN  INVESTIGATN 

C3D 

2508. 

1.35 

29.67 

2.28 

21649. 

8.6 

53.36 

17.15 

BASIC  RESEARCH 

C4D 

3695. 

0.86 

43.72 

1.46 

40063. 

10.8 

52.57 

16.82 

CLIN  MEDICINE 

CID 

4086. 

1.09 

48.35 

1.84 

32388. 

7.9 

53.22 

17.77 

BIOMED  RESEARCH 

C2D 

2826. 

1 .10 

33.44 

1.85 

33803. 

12.0 

51.78 

13.91 

BIOLOGY 

C3D 

373. 

0.98 

4.41 

1.65 

3794. 

10.2 

53.31 

27.40 

CHEMISTRY 

C4D 

86. 

0.08 

1.02 

0.13 

800. 

9.3 

57.79 

31.07 

PHYSICS 

C5D 

6  * 

0.02 

0.07 

0.04 

133. 

22.2 

74.57 

47.22 

EARTH  %  SPACE  SC 

C6D 

0. 

0.00 

0.00 

0.00 

0. 

0.0 

0.00 

0.00 

ENGRNG  S  TECHNOL 

C7D 

0. 

0.00 

0.00 

0.00 

0. 

0.0 

0.00 

0.00 

PSYCHOLOGY 

C8D 

1075. 

2.80 

12.71 

4.73 

3707. 

3.5 

52.56 

18.55 

MATHEMATICS 

C9D 

0. 

0.00 

0.00 

0.00 

0. 

0.0 

0.00 

0.00 

*Scaled  to  cited  year  1972 
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TABLE  3  (Continued) 


PAGE  2 


BID  PUBLICATION  PROFILES 

CHILD  HEALTH-HUMAN  DEVELOPMENT  -  NICHHD 
CITED  YEAR  J  1970  -  74 

BASED  ON  CITES  RECEIVED  FROM  ALL  CITING  YEARS  1973-77 
CITED  AND  CITING  ARTICLES  FROM  293  BID  JOURNAL  SET 


CITES*  %  PAPERS 


NUMBER- 

ACTIV 

X  INT 

y.  EXT 

TOTAL* 

PER 

CITE 

AMONG 

LEVEL/FIELD/SUBFIELD 

CLIN  MEDICINE  CIH 

PAPERS 

INDEX 

EFFRT 

EFFRT 

CITES 

PAPER 

T-SCR 

TOP  10% 

GENRL  1  INTERNAL  MED 

551  . 

0.97 

6.52 

1.65 

5191  . 

9.4 

52.43 

15.03 

ALLERGY 

15» 

1.50 

0.17 

2.54 

220. 

15.0 

63.31 

26.14 

ANESTHESIOLOGY 

6. 

0.15 

0.07 

0.26 

13. 

2.1 

45.97 

0.00 

CANCER 

57. 

0.28 

0.67 

0.47 

583. 

10.3 

52.20 

15.00 

CARDIOVASCULAR  SYSTM 

27. 

0,18 

0.31 

0.30 

249. 

9.4 

52.74 

19.50 

DENTISTRY 

49. 

0.45 

0.53 

0.76 

74. 

1.5 

48.54 

3.38 

DERMAT  1  VENERL  DIS 

8. 

0.21 

0.10 

0.35 

38. 

4.6 

55.78 

18.00 

ENDOCRINOLOGY 

966. 

5.28 

11.43 

8.92 

11872. 

12.3 

54.86 

17.10 

FERTILITY 

328. 

5.92 

3.88 

10.00 

1874. 

5.7 

52.78 

17.07 

GASTROENTEROLOGY 

17. 

0.36 

0.20 

0.61 

74. 

4.5 

46.70 

2.02 

GERIATRICS 

131  . 

3.27 

1 . 55 

5.53 

296. 

2.3 

55.91 

29.55 

HEMATOLOGY 

35. 

0.46 

0.41 

0.78 

292. 

8.5 

54.11 

21.26 

IMMUNOLOGY 

113. 

0.47 

1.34 

0.80 

1201 . 

10.6 

49.60 

8.25 

OBSTETRICS  1  GYNECOL 

377. 

3.90 

4.46 

6.59 

2611 . 

6.9 

56.58 

24.86 

NEUROL  1  NEUROSURG 

338. 

1.00 

4.00 

1.70 

2905. 

8.6 

51.41 

12.07 

OPHTHALMOLOGY 

17. 

0.20 

0.20 

0.33 

149. 

8.8 

63.82 

30.69 

ORTHOPEDICS 

23. 

0.45 

0.28 

0.76 

96. 

4.1 

56.43 

31.43 

ARTHRITIS  S  RHEUMAT 

4. 

0.20 

0.05 

0.34 

9. 

2.2 

41.23 

8.00 

OTORHINOLARYNGOLOGY 

36. 

0.57 

0.42 

0.96 

97. 

2.7 

53.86 

24.88 

PATHOLOGY 

62. 

0.71 

0.74 

1  .  19 

342. 

5 . 5 

51.76 

13.40 

PEDIATRICS 

592. 

4.79 

7.00 

8.09 

3816. 

6.4 

54.25 

17.62 

PHARMACOLOGY 

136. 

0.59 

1.61 

0.99 

1183. 

8.7 

53.18 

18.53 

PHARMACY 

14  . 

0.14 

0.16 

0.24 

106. 

7.8 

61.19 

47.56 

PSYCHIATRY 

40. 

0.38 

0.47 

0.65 

172. 

4.3 

52.31 

17.15 

RADIOLOGY  &  NUCL  MED 

21  . 

0.14 

0.25 

0.23 

45. 

2.1 

47.34 

3.15 

RESPIRATORY  SYSTEM 

13. 

0.30 

0.15 

0.51 

128. 

10.1 

62.97 

18.42 

SURGERY 

27. 

0.10 

0.32 

0.17 

103. 

3.8 

50.19 

12.27 

TROPICAL  MEDICINE 

0. 

0.03 

0.01 

0.05 

2. 

3.9 

53.14 

0.00 

UROLOGY 

11  . 

0.18 

0.13 

0.30 

26. 

2.4 

50.69 

16.42 

NEPHROLOGY 

0. 

0.05 

0.00 

0.08 

2. 

6.6 

75.36 

100.00 

VETERINARY  MEDICINE 

35. 

0.51 

0.42 

0.87 

77. 

2.2 

54.29 

23.22 

ADDICTIVE  DISEASES 

0. 

0.00 

0.00 

0.00 

0. 

0.0 

0.00 

0.00 

HYGIENE  1  PUBL  HLTH 

38. 

0.56 

0.45 

0.94 

125. 

3.3 

54.08 

24.56 

MISC  CLINICAL  MED 

0. 

0.00 

0.00 

0.00 

0. 

0.0 

0.00 

0.00 

*Scaled  to  cited  year  1972 
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TABLE  3  (Continued) 


PAGE  3 


BID  PUBLICATION  PROFILES 

CHILD  HEALTH-HUMAN  DEVELOPMENT  -  NICHHD 
CITED  YEAR  !  1970  -  76 

BASED  ON  CITES  RECEIVED  FROM  ALL  CITING  YEARS  1973-77 
CITED  AND  CITING  ARTICLES  FROM  293  BID  JOURNAL  SET 


CITES  *  Z  PAPERS 


NUMBER 

ACTIV 

%  INT 

%  EXT 

TOTAL* 

PER 

CITE 

AMONG 

LEVEL/FIELD/SUBFIELD 

BIOMED  RESEARCH  C2: 

PAPERS 

INDEX 

EFFRT 

EFFRT 

CITES 

PAPER 

T-SCR 

TOP  10% 

PHYSIOLOGY 

155, 

0.91 

1.83 

1.53 

1515. 

9.8 

50.42 

11.18 

ANATOMY  &  MORPHOLOGY 

151  . 

6.15 

1.78 

10.39 

857. 

5.7 

53.13 

19.69 

EMBRYOLOGY 

282, 

9.70 

3.34 

16.39 

2897. 

10.3 

55.30 

17.90 

GENETICS  S  HEREDITY 

109» 

1.31 

1.28 

2.21 

778. 

7.2 

52.08 

12.29 

NUTRITION  1  DIETET 

101 . 

2.24 

1.20 

3.79 

658. 

6.5 

56.12 

22.70 

BIOCHEM  S  MOLEC  BIOL 

1153. 

1.04 

13.64 

1.76 

15470. 

13.4 

51.48 

13.79 

BIOPHYSICS 

6. 

0.30 

0.07 

0.51 

43. 

7.9 

53.69 

27.27 

CELL  BIOL  CYT  &  HIST 

337. 

2.05 

3.99 

3.47 

3539. 

10.5 

52.19 

14.05 

MICROBIOLOGY 

39. 

0.25 

0.46 

0.42 

261 . 

6.7 

53.87 

20.85 

VIROLOGY 

19. 

0.18 

0.22 

0.30 

233. 

12.3 

49.57 

3.51 

PARASITOLOGY 

12. 

0.22 

0.14 

0.37 

36. 

3.0 

53.95 

23.61 

BIOMEDICAL  ENGINRNG 

8. 

0.54 

0.10 

0.91 

32. 

3.9 

63.73 

18.00 

MICROSCOPY 

0. 

0.00 

0.00 

0.00 

0. 

0.0 

0.00 

0.00 

MISC  BIOMEDICAL  RES 

31  . 

1.47 

0.37 

2.48 

59. 

1.9 

56.26 

37.43 

GENRL  BIOMEDICAL  RES 

423. 

0.73 

5.01 

1.24 

7700. 

18.2 

53.98 

21.75 

*Scaled  to  cited  year  1972 
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CROSSCUTTING  RESEARCH 


Table  4  opens  a  small  window  on  the  breadth  of  relations  between 
biomedical  disciplines  and  the  programmatic  interests  of  NIH.  Shown  in  the 
table  are  the  clinical  medical  fields  and  basic  bioscience  disciplines  that 
were  supported  by  more  than  one  NIH  Institute  as  reflected  in  1970-1977 
publications.  One  hundred  papers  is  the  arbitrary  minimum  number  of  papers 
used  here  to  define  significant  involvement.  During  this  period,  only  one 
BID  was  significantly  involved  with  the  production  of  publications  in  the 
following  disciplines; 

Respiratory  System  (NHLBI  -  384  papers) 

Tropical  Medicine  (NIAID  -  210  papers) 

Hygiene  and  Public  Health  (NIAID  -  121  papers) 

Parasitology  (NIAID  -  709  papers) 

Biomedical  Engineering  (NHLBI  -  108  papers) 

•The  fields  and  disciplines  that  have  been  most  widely  influenced  by  NIH 
programmatic  interests  (i.e.  more  than  half  the  Institutes  supported  a 
significant  number  of  papers)  are: 

General  and  Internal  Medicine 

Endocrinology 

Immunology 

Neurology  and  Neurosurgery 

Pathology 

Pediatrics 

Pharmacology 

Physiology 

Biochemistry  and  Molecular  Biology 
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Crosscutt  intj  OiumoiJical  SultficMs 
NiimUer  of  Papers  >-  100  Acknowloilgliiq  Support  of  Carli  DIO 
1970-76  Papers  in  275  It  ioiiiod ical  Journals 


S! 


I  I 
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APPENDIX  A:  LIST  OF  FORMAL  REPORTS  AND  PAPERS 


NIH  EVALUATION  PROJECT  NIH  73-2 


Published  Papers 

1.  Narin,  Francis,  Pinski,  Gabriel  and  Gee,  Helen.  Structure  of  the 

Biomedical  Literature.  Journal  of  the  American  Society  for 
Information  Science  27,  1,  25-45,  Jan. -Feb.  1976. 

2.  Frame,  J.  Davidson,  and  Narin,  Francis.  NIH  Funding  and 

Biomedical  Publication  Output.  Federation  Proceedings,  35,  14, 
2529-2532,  Dec.,  1976. 

3.  Frame,  J.  Davidson  and  Narin,  Francis.  International  Distribution 

of  Biomedical  Publications.  Federation  Proceedings,  36,  6, 
1790-1795,  May,  1977. 

4.  Narin,  Francis  and  Shapiro,  Rosalie  T.  The  Extramural  Role  of  the 

NIH  as  a  Research  Support  Agency.  Federation  Proceedings,  36, 
2470-2475,  Nov.,  1977. 

5.  Narin,  Francis  and  Keith,  Stephen  3.  The  Intramural  Role  of  the 

NIH  as  a  Biomedical  Research  Institute.  Federation  Proceedings, 
37,  2120-2123,  June,  1978. 


Reports : 


6.  Evaluation  of  Linkage  Between  Research  Publications  and  NIH  Funding. 
Summary  of  Work.  March  73  -  June  74.  (Prepared  by  Francis  Narin), 
Sept.  1974. 

7.  Structure  of  the  Biomedical  Literature.  (Prepared  by  Gabriel 
Pinski),  November,  1975. 

8.  Distribution  of  International  Biomedical  Literature.  (Prepared  by  J. 
Davidson  Frame),  June  1976. 

9.  Profiles  of  Supported  Research  Publications  -  For  NIH  3/I/D' s  in  1973 
and  Other  Biomedical  Research  Support  Agencies.  (Prepared  by  Rosalie 
T.  Shapiro),  September  1976. 

10.  Cross  Institute  Integration  of  Research  Supported  by  NIH.  (Prepared 
by  Francis  Narin,  Rosalie  Shapiro  and  Gabriel  Pinski).  Delivered  at 
Second  Annual  Meeting,  Society  for  Social  Studies  of  Science, 

October,  1977. 
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n.  Mul ti-dimensional  Scaling  Models  of  Subfield  and  3/I/RD 

Interactions.  (Prepared  by  Gabriel  Pinski),  December,  1977. 

12.  Bibliometric  Characterization  of  Research  Papers  from  U.S.  Medical 
Schools.  (Prepared  by  Paul  McAllister  and  Francis  Narin), 
Delivered  at  Third  Annual  Meeting,  Society  for  Social  Studies  of 
Science,  Nov.  1978.  Being  updated  for  journal  submission. 

13.  Trends  in  NIH  Funding  and  the  Production  of  Biomedical  Papers. 
(Prepared  by  J.  Davidson  Frame,  Francis  Narin  and  Helen  H.  Gee), 
March,  1980.  (To  be  submitted  for  Journal  publication.) 

14.  Bibliometric  Characterization  of  Transient  and  Resident  Scientists 
in  a  Specialty  Area.  (Manuscript  in  preparation  by  Francis  Narin 
and  D.  Wagner) 


Related  Documents 


15.  Narin,  Francis.  Evaluative  Bibl iometrics ;  The  Use  of  Publication 
and  Citation  Analysis  in  the  Evaluation  of  Scientific  Activity. 
National  Science  Foundation.  March,  1976.  Monograph:  456  pp. 
NTIS  Accession  #PB252339/AS . 


16. 


Pinski,  Gabriel  and  Narin,  Francis 
Journal  Aggregates  of  Scientific 
Application  to  the  Literature  of 
Processing  and  Management  12(5), 


Citation  Influence  for 
Publications:  Theory,  With 
Physics.  Information 
297-312,  1976. 


17.  Science  Citation  Index.  Copyright  Institute  for  Scientific 
Information. 


18.  Science  Indicators.  1972,  1974,  1976,  1978.  Reports  of  the 

National  Science  Board,  Washington,  D.C.:  Government  Printing 
Office,  1973,  1975,  1977,  1979. 
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APPENDIX  8:  LISTING  OF  "mE  8/1/0  JOURNAL  SET  8Y  SUBFIELD 


GENRL  &  INTERNAL  MED 

AM  J  MED  (L2) 

AM  J  MED  SC  (L2) 
ANN  INT  MED  (LI) 
ARCH  IN  MED  (L2) 
BIOCHEM  MED  (L3) 
CLIN  CHEM  (L3) 
CLIN  CHIM  A  (L3) 
CLIN  SC  MOL  (L3) 
J  AM  MED  A  (LI) 

J  CHRON  OIS  (LI) 
J  CLIN  INV  (L3) 

J  LA  CL  MED  (L3) 
LANCET  (L2) 
MEDICINE  (L2) 

N  ENG  J  MED  (L2) 
P  SOC  EXP  M  (L3) 
SOUTH  MED  J  (LI) 
YALE  J  BIOL  (L3) 

ALLERGY 

J  ALLERG  CL  (L2) 

ANESTHESIOLOGY 

ANESTH  ANAL  (L2) 
ANESTHESIOL  (L2) 

CANCER 

CANC  CHEMOT  (L3) 
CANCER  (L2) 
CANCER  RES  (L3) 
INT  J  CANC  (L3) 

J  NAT  CANC  (L3) 
ONCOLOGY  (L2) 


DENTISTRY 

AM  J  ORTHOO  (L2) 
ARCH  ORAL  8  (L3) 
J  AM  DENT  A  (Ll) 
J  DENT  RES  (L3) 

J  PERIOOONT  (L2) 
ORAL  SURG  0  (L2) 
PERIODONTIC 

DERMAT  &  VENERL  DIS 

ARCH  DERMAT  (L2) 
J  INVES  DER  (L3) 

ENDOCRINOLOGY 

DIABETES  (L3) 
ENDOCRINOL  (L3) 
GEN  C  ENDOC  (L4) 
J  CLIN  END  (L3) 

J  ENDOCR  (L3) 
METABOLISM  (L3) 
NEUROENOOCR  (L3) 

FERTILITY 

FERT  STERIL  (L2) 
J  REPR  FERT  (L3) 

GASTROENTEROLOGY 

AM  J  DIG  01  (L2) 
GASTROENTY  (L2) 

GERIATRICS 

GERIATRICS  (Ll) 
GERONTOL  (Ll) 

J  AM  GER  SO  (Ll) 
J  GERONTOL  (L2) 
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CARDIOVASCULAR  SYSTM 

AM  HEART  J  (L2) 
AM  J  CARD  (L2) 
CHEST  (LI) 

CIRCUL  RES  (LS) 
CIRCULATION  (L2) 

IMMUNOLOGY 

CLIN  EXP  IM  (L2) 
IMMUNOCHEM  (L3) 
IMMUNOLOGY  (L3) 

J  EXP  MED  {L3) 

J  IMMUNOL  (L3) 

J  INFEC  OIS  (L2) 
J  RETIC  SOC  (L3) 
TRANSPLAN  P  (L3) 
TRANSPLANT  (L3) 

OBSTETRICS  &  GYNECOL 

AM  J  OBST  G  (L2) 
OBSTET  GYN  (LI) 

NEUROL  &  NEUROSURG 

ARCH  NE  PSY  (LI) 
ARCH  NEUROL  (L2) 
BRAIN  RES  (L4) 
DEVELOP  MED  (L2) 
EEG  CL  NEUR  (L3) 
EPILEPSIA  (L2) 
EXP  BRAIN  R  (L4) 
EXP  NEUROL  (L4) 

J  COMP  NEUR  (L4) 
J  NE  EXP  NE  (L3) 
J  NE  NE  PSY  (L2) 
J  NEUROCHEM  (L4) 
J  NEUROSURG  (LI) 
J  NEURPHYSL  (L4) 
NEUROLOGY  (L2) 
VISION  RES  (L4) 

OPHTHALMOLOGY 

AM  J  OPHTH  (L2) 
ARCH  OPHTH  (L2) 
EXP  EYE  RES  (L3) 
INV  OPHTH  V  (L3) 


HEMATOLOGY 

BLOOD  (L3) 

BR  J  HAEM  (L3) 
THROMB  DIAT  (L3) 
VOX  SANGUIN  (L3) 


ARTHRITIS  &  RHEUMAT 

ANN  RHEUM  D  (L2) 
ARTH  RHEUM  (L2) 

OTORHINOLARYNGOLOGY 

ANN  OTOL  RH  (L2) 
ARCH  OTOLAR  (LI) 

J  SPEECH  HE  (L2) 
LARYNGOSCOP  (LI) 

PATHOLOGY 

AM  J  CLIN  P  (L2) 

AM  J  PATH  (L3) 

ARCH  PATH  (L2) 

EXP  MOL  PAT  (L3) 

LAB  INV  (L3) 

PEDIATRICS 

AM  J  OIS  CH  (L2) 
BIOL  NEONAT  (L3) 

J  PEDIAT  (L2) 

PEDIAT  RES  (L3) 
PEDIATRICS  (L2) 

PHARMACOLOGY 

BIOCH  PHARM  (L3) 
CLIN  PHARM  (L2) 

CURR  THER  R  (Li) 

EUR  J  PHARM  (L3) 

J  CLIN  PHAR  (LI) 

J  PHARM  EXP  (L3) 
MOLEC  PHARM  (L3) 
NEURO PHARM  (L3) 
PHARM  REV  (L3) 
PSYCHOPHARM  (L3) 

TOX  APPL  PH  (L3) 
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ORTHOPEDICS 


PHARMACY 


CLIN  ORTHOP  (L2) 

J  BONE  JOIN  (LI) 

J  BONE  -  AM  V  (LI) 

PSYCHIATRY 

AM  J  ORTHOP  (LI) 

AM  J  PSYCHI  (LI) 
ARCH  G  PSYC  (LI) 
ARCH  NE  PSY  (LI) 

BR  J  PSYCHI  (LI) 
DIS  NER  SYS  (LI) 

J  NERV  MENT  (LI) 

J  PSYCH  RES  (L2) 
PSYCHOS  MED  (L2) 

RADIOLOGY  &  NUCL  MED 

AM  J  ROENTG  (LI) 
INV  RADIOL  (L2) 

J  NUCL  MED  (L2) 
RADIAT  RES  (L4) 
RADIOLOGY  (L2) 

SEM  ROENTG  (LI) 

RESPIRATORY  SYSTEM 

AM  R  RESP  D  (L2) 
CHEST  (LI) 

RESP  PHYSL  (L4) 

SURGERY 

AM  J  SURG  (LI) 

ANN  SURG  (LI) 

ARCH  SURG  (LI) 

J  PED  SURG  (LI) 

J  SURG  RES  (L2) 

J  THOR  SURG  (LI) 

J  TRAUMA  (LI) 

PLAS  R  SURG  (LI) 
SURG  GYN  06  (LI) 
SURGERY  (LI) 

T  AM  S  ART  (LI) 

TROPICAL  MEDICINE 

AM  J  TROP  M  (L2) 


J  MED  CHEM  (L3) 

J  PHARM  SCI  (L3) 


NEPHROLOGY 

NEPHRON  (L2) 

VETERINARY  MEDICINE 

AM  J  VET  RE  (L3) 
J  AM  VET  ME  )L2) 

HYGIENE  &  PUBL  HLTH 


AM  J  EPIDEM  (L2) 
AM  J  PUB  HE  (LI) 
ARCH  ENV  HE  (L2) 

B  WHO  (L2) 

PHYSIOLOGY 

AM  J  PHYSL  (L4) 
ANN  R  PHYSL  (L4) 

J  APP  PHYSL  (L4) 

J  GEN  PHYSL  (L4) 

J  PHYSL  LON  (L4) 
LIFE  SCI  PI  (L4) 
PHYSIOL  REV  (L4) 

ANATOMY  &  MORPHOLOGY 

AM  J  ANAT  (L4) 
ANAT  REC  (L4) 

EMBRYOLOGY 

DEVELOP  BIO  (L4) 
TERATOLOGY  (L4) 

GENETICS  &  HEREDITY 

AM  J  HU  GEN  (L3) 
ANN  HUM  GEN  (L3) 
BIOCHEM  GEN  (L4) 
CHROMOSOMA  (L4) 
GENETICS  (L4) 
MUTAT  RES  (L4) 
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UROLOGY 


INV  UROL  (L2) 
J  UROL  (LI) 


BIOCHEM  &  MOLEC  BIOL 

ANALYT  BIOC  (L4) 
ANN  R  BIOCH  (L4) 
ARCH  BIOCH  (L4) 
BIOC  BIOP  A  (L4) 
BIOC  BIOP  R  (L4) 
BIOCHEM  (L4) 
BIOCHEM  J  (L4) 
BIOPOLYMERS  (L4) 
COLD  S  HARB  (L4) 
EUR  J  BIOCH  (L4) 
FEBS  LETTER  (L4) 
J  BIOL  CHEM  (L4) 
J  LIPID  RES  (L4) 
J  MOL  BIOL  (L4) 

J  THEOR  BIO  (L4) 
LIFE  SCI  P2  (L4) 
LIPIDS  (L4) 
STEROIDS  (L4) 

BIOPHYSICS 

ANN  R  BIOPH  (L4) 
BIOPHYS  J  {L4} 

J  BIOMECHAN  (L4) 

CELL  BIOL  CYT  &  HIST 

ACT  CYTOL  (L2) 
CALCIF  TISS  (L3) 
EXP  CELL  RE  (L4) 
J  CELL  BIOL  (L4) 
J  CELL  PHYS  (L4) 
J  HIST  CYTO  (L4) 
J  MEMBR  BIO  (L4) 
J  ULTRA  RES  (L4) 
STAIN  TECH  (L4) 

MICROBIOLOGY 

ANN  R  MICRO  (L4) 
APPL  MICROS  (L4) 
J  BACT  (L4) 

J  GEN  MICRO  (L4) 


NUTRITION  &  DIETET 

AM  J  CLIN  N  (L4) 
J  NUTR  (L4) 

PARASITOLOGY 

EXP  PARASIT  (L4) 
J  PARASITOL  (L4) 
J  PROTOZOOL  (L4) 

BIOMEDICAL  ENGINRNG 

COMPUT  BIOM  (L3) 
IEEE  BIOMED  (L3) 

MISC  BIOMEDICAL  RES 

HUMAN  BIOL  (L3) 
LAB  ANIM  SC  (L3) 


GENRL  BIOMEDICAL  RES 

ANN  NY  ACAD  (L4) 
EXPERIENTIA  (L4) 
FED  PROC  (L4) 

LIFE  SCI  (L4) 
NATURE  {L4) 

P  NAS  US  (L4) 
SCIENCE  (L4) 


GENERAL  BIOLOGY 

ANN  NY  ACAD  (L4) 
EXPERIENTIA  (L4) 
NATURE  (L4) 

P  NAS  US  (L4) 
SCIENCE  (L4) 


GENERAL  ZOOLOGY 

AM  ZOOLOG  (L4) 

J  EXP  ZOOL  (L4) 
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VIROLOGY 

ENTOMOLOGY 

J  GEN  VIROL  (L4) 

J  VIROLOGY  (L4) 

VIROLOGY  (L4) 

J  MED  ENT  (L3) 

MISCELLANEOUS  ZOOL 

COMP  BIOCH  (L4) 

BOTANY 

POLYMERS 

PHYTOCHEM  (L4) 

PLANT  PHYSL  (L4) 

J  POL  SC  PP  (L3) 

AGRICULT  &  FOOD  SCI 

PHYSICAL  CHEMISTRY 

J  AGR  FOOD  (L3) 

ACT  CRYST  (L4) 

J  CHEM  S  (L4) 

J  PHYS  CHEM  (L4) 

DAIRY  &  ANIMAL  SCI 

CHEMICAL  PHYSICS 

J  ANIM  SCI  (L3) 

J  DAIRY  SCI  (L3) 

J  CHEM  PHYS  (L4) 

J  CHEM  S  (L4) 

MISCELLANEOUS  BIOL 

ACOUSTICS 

AM  J  P  ANTH  (L4) 

J  ACOUST  SO  (L3) 

ANALYTICAL  CHEMISTRY 

CLINICAL  PSYCHOLOGY 

ANALYT  CHEM  (L3) 

J  CHROMAT  (L3) 

J  ABN  PSYCH  (LI) 

ORGANIC  CHEMISTRY 

PERSONALITY  &  SOC  PS 

CARBOHY  RES  (L4) 

J  CHEM  S  (L4) 

J  HETERO  CH  (L4) 

J  ORG  CHEM  (L4) 

TETRAHEDR  L  (L4) 

J  PERS  SOC  (LI) 

INORGANIC  &  NUCL  CHM 

INORG  CHEM  (L4) 

J  CHEM  S  0  (L4) 

GENERAL  CHEMISTRY 

ANN  NY  ACAD  (L4) 
CHEM  COMM  (L4) 
EXPERIENTIA  (L4) 
J  AM  CHEM  S  (L4) 
J  CHEM  S  (L4) 

J  CHEM  S  CH  (L4) 
NATURE  (L4) 

P  NAS  US  (L4) 
SCIENCE  (L4) 


GENERAL  PSYCHOLOGY 

J  PSYCHOL  (LI) 
PSYCHOL  REP  (L2) 
SCIENCE  (L4) 

BEHAVIORAL  SCIENCE 

BEHAV  RES  M  (L4) 
J  APPL  BE  A  (LI) 
J  EXP  AN  BE  (L3) 
PHYSL  BEHAV  (L4) 


Ij-U.s.  GOVERNMENT  PRIN 


DEVEL  &  CHILD  PSYCHO 

CHILD  DEV  (L2) 

J  EXP  C  PSY  (L2) 

EXPERIMENTAL  PSYCHOL 

J  COM  PHYSL  (L4) 

J  EXP  PSYCH  (L4) 
NEUROPSYCHO  (L3) 
PERC  MOT  SK  (L2) 
PERC  PSYCH  (L4) 
PSYCHOPHYSL  (L3) 


MISC  PSYCHOLOGY 
AM  J  MENT  D  (LI) 
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